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FOREWORD 


Since  1974-75,  the  Statewide  Educational  Assessment  Program  has  provided 
Massachusetts  citizens  with  useful  information  about  the  quality  of 
education  in  Massachusetts.  The  results  of  four  years  of  the  Assessment 
program  have  informed  parents,  students,  educators,  public  officials  and 
employers  about  statewide  patterns  of  student  performance  in  such  areas 
as  writing,  mathematics,  social  studies,  science,  consumer  education  and 
career  and  occupational   development. 

During   1977-78,   13-  and  17-year-old  students  were  assessed,   for  the  second 
time,   in  career  and  occupational   development.     This  report  describes   the 
results  of  this  assessment  and  provides  information  for  the  first  time  on 
trends   in  the  performance  of  students   in  career  and  occupational   develop- 
ment.    Readers   interested  in  more  detailed  technical   information  about 
this  assessment  may  obtain  a  copy  of  the  technical   publication  by  contac- 
ting either  the  Bureau  of  Research  and  Assessment  or  one  of  the  regional 
offices  of  the  Department  of  Education. 

Also  for  the  first  time,   this  report  provides  the  reader  with  some  inter- 
pretations of  the  meaning  and  implications  of  the  assessment  findings 
through  the  concentrated  involvement  of  many  educators  throughout  the 
Commonwealth.     To  them,  and  to  the  many  others  whose  involvement  may  not 
have  been  explicitly  acknowledged,   the  Board  of  Education  expresses   its 
sincere  appreciation. 

Finally,   it  should  be  pointed  out  that  31  school   systems  chose  to  use  the 
tests  and  procedures  developed  for  the  statewide  assessment  at  the  local 
level.     I   am  pleased  to  report  that,  overall,   these  systems   found  using 
this   local   option  highly  beneficial. 

It  is  our  feeling  that  this  year's  assessment  reports  should  find  even 
wider  audiences   than  in  the  past.     I   am  pleased,   therefore,  to  present 
this  year's  Career  and  Occupational   Development  assessment  findings  for 
review  by  all    interested  citizens. 


Charles  Grigsby 

Chairperson 

Massachusetts  Board  of  Education 
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I.  INTRODUCTION 


Overview 


PURPOSE.     The  Massachusetts  Statewide  Educational  Assessment  is  a  contin- 
uing series  of  annual  evaluations  of  the  knowledge,  understanding,  skills, 
and  attitudes  of  Massachusetts  public  school  students.  As  established  by 
the  Massachusetts  State  Board  of  Education,  the  purpose  of  the  statewide 
assessment  is  to: 


•  provide  citizens,  students,  parents,  legislators,  and  educators 
with  useful  and  accurate  information  on  the  quality  of  education 
in  Massachusetts 

provide  state- level  decision  makers  with  information  necessary  for 
setting  educational  policy 

help  local  school  systems  set  their  own  objectives  by  providing 
them  with  statewide  information  on  patterns  of  performance  and 
attitudes  and  strengths  and  weaknesses  of  students 

•  enable  local  school  districts  to  develop  and  to  implement  their  own 
assessments  by  making  statewide  assessment  procedures  available  to 
them 


• 


• 


BACKGROUND.     Since  1974,  Massachusetts  statewide  assessments  have  been 
conducted  in  reading,  mathematics,  writing,  social  studies,  citizenship, 
science,  ecology,  consumer  education,  career  and  occupational  education, 
foreign  languages,  decision  making,  and  school  climate.  The  1977-78 
assessment  marks  a  second  survey  of  the  reading  and  career/occupational 
education  areas.  In  future  years,  repeated  assessments  will  be  made  in 
other  learning  areas  as  well  in  order  to  examine  changes  in  patterns  of 
student  performance. 


THE  1977-78  ASSESSMENT.     This  year,  the  assessment  in  the  area  of  Career 
and  Occupational  Development  (COD)  was  conducted  by  National  Evaluation 
Systems,  Inc.  (NES)  of  Amherst,  Massachusetts,  under  contract  to  the 
Massachusetts  Department  of  Education  (MDE).  Staff  of  both  NES  and  MDE 
worked  jointly  on  all  aspects  of  the  assessment  program.  Major  program 
components  included  the  development  of  the  test  instruments,  administra- 
tion of  the  tests  to  a  sample  of  13-year-olds  and  17-year-olds  throughout 
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the  state,  analysis  and  interpretation  of  the  data,  and  dissemination  of 
the  results.  In  conjunction  with  the  statewide  assessment,  MDE  provided 
local  school  districts  an  opportunity  to  use  the  state's  custom-designed 
materials  to  assess  their  own  students  through  the  Local  Assessment 
Option. 

JJSim  THE  RESULTS.     The  purpose  of  the  statewide  assessment  is  to  permit 
a  detailed  examination  of  the  performance  of  students  statewide  and  of 
students  in  different  educational  regions  and  kinds  of  communities  within 
the  state.  Categorizing  students  in  this  way  allowed  personnel  in  local 
school  districts  that  did  not  participate  in  the  local  option  to  gauge  the 
performance  of  their  own  students  by  inference  from  the  results  for  their 
own  region  as  a  whole  or  for  similar  communities.  This  information  can 
assist  these  districts  in  identifying  areas  of  strength  and  weakness  which 
warrant  investigation  of  the  achievement  of  their  students  in  particular. 
Those  districts  that  did  participate  in  the  local  option  may  use  the 
results  presented  here  to  make  direct   comparisons  with  statewide,  regional, 
and  kind-of-community  results. 


Measurement  Instruments 

TEE  TESTS.     As  in  previous  Massachusetts  assessments,  the  COD  test  was 
objective-referenced  in  nature.  Such  tests  are  designed  to  describe 
achievement  with  regard  to  specific  objectives;  a  student's  score  reflects 
achievement  relative  to  definite  tasks  rather  than  to  preset  norms. 

A  Technical  Committee  composed  of  a  cross  section  of  Massachusetts 
educators,  primarily  career  education  teachers  and  counselors,  provided 
leadership  to  the  test  development  effort.  Because  the  committee  was 
interested  in  comparing  the  achievement  of  the  two  age  groups,  a  single 
test  was  developed  to  be  administered  to  both  13-  and  17-year-olds.  After 
a  careful  review  of  available  materials,  the  committee  identified  five 
major  objectives  and  a  total  of  113  matching  test  questions  for  inclusion 
on  the  test.  A  total  of  61  of  these  items  had  been  previously  used  in  the 
1974-75  Massachusetts  assessment  of  17-year-olds.  In  addition,  28  items 
were  drawn  from  the  materials  of  the  National  Assessment  of  Educational 
Progress  (NAEP).  Examination  of  scores  on  these  items  permits  comparisons 
between  current  and  previous  Massachusetts  performance,  and  between  per- 
formance in  Massachusetts,  the  Nation,  and  the  Northeast  Region.  The 
remaining  24  items  were  drawn  from  the  NES  item  bank. 

TEE  OBJECTIVES.      Each  test  item  v/as  matched  to  one  of  the  following  five 
COD  objectives: 

1.  Joh  Chavaotevisties:     knowledge  of  the  characteristics  (classifi- 
cations, major  duties,  nature  of  tasks,  and  salary)  of  various 
careers  and  occupations. 
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2.  Job  Requirements:     knowledge  of  the  abilities,  training,  and 
preparation  required  or  useful  for  various  careers  and  occupations. 

3.  Career  Deoision  Making:     knowledge  and  ability  necessary  to  plan 
and  implement  career  decisions. 

4.  Basic  Skills:     application  of  basic  skills  (numerical,  communi- 
cations, and  interpersonal)  useful  in  seeking  and  retaining 
employment. 

5.  Attitudes  and  Values:     personal  attitudes  and  values  contributing 
to  career  success. 

STUDENT  AND  PRINCIPAL  QUESTIONNAIRES,  The  purpose  of  developing  student 
and  principal  questionnaires  was  twofold:  (1)  to  identify  characteristics 
of  students  and  their  schools  that  might  bear  a  relationship  to  achievement 
and  (2)  to  provide  a  general  characterization  of  students  and  schools  that, 
in  itself,  might  prove  useful  in  policy  decisions.  Questionnaires,  which 
were  designed  by  the  Technical  Committee,  were  administered  to  all  partici- 
pating students  and  to  principals  of  all  schools  enrolling  these  students. 


Test  Administration 

To  limit  the  burden  placed  on  school  personnel,  all  test  sessions  were 
conducted  by  trained  test  administrators.  Testing  sessions,  lasting  about 
75  minutes,  included  the  administration  of  both  the  student  questionnaire 
and  the  test. 

All  data  collection  occurred  during  February  and  March,  1978.  A  total 
of  2,238  13-year-olds  representing  93  schools  and  2,201  17-year-olds 
representing  101  schools  participated  in  the  assessment. 

In  order  to  ensure  standardized  and  valid  testing  sessions,  workshops  on 
test  administration  procedures  were  provided  for  personnel  of  local  school 
systems  participating  in  the  Local  Assessment  Option. 


Sampling  Design 

PURPOSE.      In  order  to  provide  information  about  the  achievement  performance 
of  students  throughout  Massachusetts  in  a  cost-effective  manner,  a  sample 
of  students  at  each  age  level  was  tested.  The  sampling  procedure  protected 
the  anonymity  of  all  students,  schools,  and  school  systems  participating  in 
the  assessment. 
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The  sample  at  each  age  level  was  designed  to  be  representative  of  students 
from  schools  in  each  of  the  six  Massachusetts  Educational  Regions  and  from 
schools  in  four  kinds  of  communities.  All  students  of  the  appropriate  age 
level  were  eligible  for  participation  exoe-pt  for  those  who  were  non-English- 
speaking  or  who  were  handicapped  (physically,  mentally,  or  emotionally)  in 
such  a  way  that  they  could  not  respond  to  the  test. 


STRATIFICATION  VARIABLES.     The  map  below  shows  the  division  of  the  state 
into  regions  as  defined  by  MDE.  Each  region  is  identified  in  the  key  below 
the  map.  Appendix  A  lists  all  Massachusetts  school  systems  and  their 
respective  region  and  kind  of  community. 


^  -^ 


1.  Boston  Region 

2.  Northeast  Region 

3.  Pitts  field  Region 


4.  Southeast  Region 

5.  Springfield  Region 

6.  Central  Mass.  Region 
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The  four  kinds  of  community  (KOC)  were  defined  as  follows: 


Big  Cities:  communities  designated  as  central  cities  according  to 
the  1970  United  States  Census.  Examples  include  Boston,  Brockton, 
Haverhill,  Holyoke,  Lawrence,  Worcester. 

Industrial  Suburbs:     suburbs  of  central  cities  with  below-average 
family  income  ($16,000)  and  with  more  than  20%  commercial  and  7% 
industrial  land  use.  Examples  include  Cambridge,  Chelsea,  Medford, 
Quincy,  Peabody,  Waltham,  Lee,  Monson. 

Residential  Suburbs:     suburbs  of  central  cities  other  than  Boston 
with  above-average  family  income,  and  all  nonindustrial  suburbs  of 
Boston.  Examples  include  Arlington,  Braintree,  Framingham,  Scituate, 
Walpole,  Andover,  Dover,  Milton,  Newton,  Chelmsford,  Shrewsbury, 
Wilbraham. 

Other  Communities:     resort  towns  in  the  Cape  Cod  and  Berkshire 
areas,  nonindustrial  suburbs  of  cities  other  than  Boston  with  below- 
average  family  income,  towns  with  below-average  family  income,  and 
communities  with  a  population  of  less  than  2,500.  Examples  include 
Barnstable,  Chatham,  Yarmouth,  Stockbridge,  Bridgewater,  Hadley, 
Oxford,  Stoughton,  Newburyport,  Taunton,  Ayer,  Kingston,  Orange, 
Webster,  Ashfield,  Dunstable,  Plympton. 


SAMPLE  COMPOSITION.     Table  1  describes  the  composition  of  the  sample  at 
each  age  level  in  terms  of  sex,  grade,  region,  and  kind  of  community. 


Reporting  the  Results 


Parts  II  through  V  of  this  report  describe  the  major  outcomes  of  the 
assessment  by  reporting: 


performance  on  objectives 

comparisons  of  the  achievement  of  Massachusetts  students  with  that 
of  students  in  the  Nation  and  the  Northeast  Region 

comparisons  of  achievement  among  groups  of  students  within  each  age 
group 

highlights  of  the  student  and  principal  questionnaires 
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TABLE  1 


Sample  Composition 


Variable 


Percentage  of 
13-Year-Olds 


Variable 


Percentage  of 
17-Year-Olds 


SEX 

Male 
Female 


GRADE 

6th 
7th 
8th 
9th 


REGION 

1.  Boston 

2.  Northeast 

3.  Pittsfield 

4.  Southeast 

5.  Springfield 

6.  Central  Mass 


KIND  OF  COMMUNTIY 

1.  Big  Cities 

2.  Industrial  Suburbs 

3.  Residential  Suburbs 

4.  Other  Communities 


46.6 
53.2 


0.6 
13.0 
85.9 

0.4 


26.7 
19.8 
9.1 
17.2 
10.5 
16.6 


20.1 
15.3 
37.8 
26.8 


SEX 

Male 
Femal  e 


GRADE 

9th 
10th 
nth 
12th 


REGION 

1.  Boston 

2.  Northeast 

3.  Pittsfield 

4.  Southeast 

5.  Springfield 

6.  Central  Mass 


KIND  OF  COMMUNITY 

1.  Big  Cities 

2.  Industrial  Suburbs 

3.  Residential  Suburbs 

4.  Other  Communities 


48.8 
51.2 


1.5 

7.6 

64.6 

26.2 


25.6 
19.6 

9.5 
17.0 

9.6 
18.8 


17.3 
13.1 
42.8 
26.7 
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In  addition.  Appendix  B  contains  results  on  each  test  item  by  age,  sex, 
region,  kind  of  community,  and,  where  data  is  available,  in  the  Nation, 
the  Northeast  Region,  and  the  1974-75  Massachusetts  assessment. 

More  in-depth  information  about  the  methodology  and  outcomes  of  this 
year's  assessment  is  available  in  the  Technical  Report.  Limited  copies  may 
be  obtained  from  the  Bureau  of  Research  and  Assessment  and  the  Regional 
Education  Centers  of  the  Department  of  Education. 


Interpretive  Activities 


Part  VI  of  this  report  represents  the  interpretations  and  recommendations 
based  on  the  results  of  the  assessment.  Two  activities  were  conducted  to 
assist  in  the  interpretive  process: 


Benohmavk  Panel:     A  group  of  educators,  school  administrators,  and 
business  representatives  from  throughout  Massachusetts  met  to  dis- 
cuss the  assessment  results.  Their  task  was  to  evaluate  the  actual 
performance  in  terms  of  their  own  "benchmark"  of  desirable  achieve- 
ment. Given  the  percentage  of  students  answering  correctly  each  test 
item,  the  Benchmark  Panel  attempted  to  reach  a  consensus  opinion  on 
whether  or  not  additional  emphasis  ought  to  be  placed  on  teaching 
students  the  skills  measured  by  that  item. 

Interpretive  Workshop:     The  COD  Technical  Committee  met  at  a  two- 
day  workshop  to  review  all  of  the  results  of  the  assessment.  Using 
their  professional  judgment  and  the  input  of  the  Benchmark  Panel, 
they  generated  a  set  of  interpretive  comments  and  recommendations 
for  action  based  on  the  results. 


The  outcomes  of  these  activities  presented  in  Part  VI  are  intended  to 
be  of  use  to  those  people— State  Board  of  Education  members,  legislators, 
school  superintendents,  classroom  teachers,  guidance  personnel,  and 
laypersons— concerned  with  providing  quality  career  education  programs 
throughout  Massachusetts. 
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II.  MASSACHUSETTS  RESULTS  BY  OBOECTIVE 


» 


Understanding  the  Results 


To  describe  the  achievement  of  Massachusetts  13-  and  17-year-olds,  the 
assessment  results  include  performance  scores  on  each  test  item  and  on 
each  objective.  In  this  section,  results  by  objective  are  described  for 
each  age  level  in  both  graphic  and  narrative  form.  The  full  text  of  each 
objective  appears  on  page  10. 

Figure  2  displays  the  average  percentage  of  matching  test  items  answered 
correctly  for  each  objective  by  each  age  group.  If,  for  example,  students 
at  a  given  age  level  show  an  average  of  68.2%  for  a  particular  otDJective, 
this  means  that,  on  the  average,  they  answered  correctly  68.2%  of  the 
matching  test  items. 

The  achievement  scores  presented  here  represent  best  estimates  of  the 
"true"  achievement  scores  which  would  have  been  obtained  had  all   students 
in  the  population,  rather  than  a  representative  sample,  been  tested.  Sta- 
tistical techniques  indicate  that  these  estimates  are  most  likely  to  be 
within  two  percentage  points  of  the  "true"  scores  of  the  population.  If, 
for  example,  the  statewide  score  is  shown  as  62%,  one  can  feel  confident 
that  the  "true"  statewide  score  is  between  60%  and  64%.  The  purpose  of 
this  reminder  is  to  caution  the  reader  to  refrain  from  over-emphasizing 
small  differences  between  scores. 


Summary  of  Results 

ACEIEVEMENT  ON  OBJECTIVES.     Thi rteen-year-olds  scored  between  55.1%  and 
72.7%  correct  across  the  five  objectives.  Their  lowest  performance  was  on 
Objective  2,  Knowledge  of  Job  Requirements,  while  their  highest  performance 
was  on  Objective  4,  Basic  Skills.  Scores  of  17-year-olds  ranged  between 
66.3%  and  83.2%  correct,  with  lowest  performance  on  Objective  3,  Career 
Decision  Making,  and  highest  performance  on  Objective  4,  Basic  Skills. 

On  all  five  objectives,  17-year-olds  scored  about  10  percentage  points 
higher  than  13-year-olds.  At  both  age  levels,  performance  on  Objectives  4 
and  5  was  considerably  higher  than  that  on  the  first  three  objectives. 

YEAR-TO-YEAR  COMPARISONS.     Seventeen-year-olds  performed  at  about  the  same 
level  as  Massachusetts  17-year-olds  in  the  1974-75  assessment  on  those  test 
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items  that  were  identical  in  both  years.  Across  the  61  identical  items, 
performance  varied  such  that  students  this  year  performed  above,  below,  or 
the  same  as  students  in  1974-75  depending  on  the  item.  But,  on  the  average, 
students  this  year  scored  about  two  percentage  points  higher  than  did  those 
in  1974-75.  While  this  difference  may  be  statistically  significant,  it  is 
probably  not  large  enough  to  be  educationally  meaningful. 

It  should  be  noted  that  in  the  1974-75  assessment  the  typical  student  was  a 
twelfth-grader  tested  early  in  the  school  year,  while  in  1977-78  the  typical 
student  was  an  eleventh-grader  tested  in  the  middle  of  the  school  year.  The 
fact  that  students  this  year  performed  about  the  same  as  those  tested  in 
1974-75  is  therefore  cast  in  a  more  favorable  light. 


COD  OBJECTIVES 

1.  Joh  Chavaot eristics:     knowledge  of  the  characteristics 
(classifications,  major  duties,  nature  of  tasks,  and 
salary)  of  various  careers  and  occupations. 

2.  Joh  Requirements:     knowledge  of  the  abilities,  training, 
and  preparation  required  or  useful  for  various  careers 
and  occupations. 

3.  Career  Decision  Making:     knowledge  and  ability  necessary 
to  plan  and  implement  career  decisions. 

4.  Basic  Skills:     application  of  basic  skills  (numerical, 
communications,  and  interpersonal)  useful  in  seeking  and 
retaining  employment. 

5.  Attitudes  and  Values:     personal  attitudes  and  values 
contributing  to  career  success. 
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III.  COMPARING  MASSACHUSETTS  WITH  THE  NATION 
AND  THE  NORTHEAST  REGION 


Introduction 


To  put  into  perspective  the  achievement  of  Massachusetts  students,  results 
presented  here  compare  Massachusetts  students  v/ith  students  in  the  Nation 
and  the  Northeast  Region  tested  by  the  National  Assessment  of  Educational 
Progress  (NAEP).  The  results  described  here  are  for  only  those  items  that 
were  the  same  on  both  the  NAEP  and  Massachusetts  tests  and  administered  to 
the  same  age  levels  in  both  assessments. 

Figures  3  and  4  show  the  average  percentage  of  these  test  items  answered 
correctly  for  each  objective  by  students  in  Massachusetts,  the  Nation,  and 
the  Northeast  at  the  two  respective  age  levels.  The  Northeast  Region  is 
defined  by  NAEP  as  including  Maine,  New  Hampshire,  Vermont,  Massachusetts, 
Connecticut,  Rhode  Island,  New  York,  New  Jersey,  Washington  D.C., 
Pennsylvania,  and  Maryland. 

The  reader  should  bear  in  mind  that  NAEP  uses  paced  audiotapes  to  accompany 
the  tests,  while  Massachusetts  did  not.  Further,  NAEP  tests  13-year-olds 
in  October  through  December  and  17-year-olds  in  March  and  April,  while 
Massachusetts  tested  both  ages  in  February  and  March.  There  is  no 
conclusive  evidence  as  to  the  impact  of  these  differences  on  achievement. 


Summary  of  Results 

There  was  a  total  of  28  NAEP  items  on  the  Massachusetts  test,  of  v;hich  NAEP 
administered  19  to  both  age  levels,  six  only  to  13-year-olds,  and  three 
only  to  17-year-olds. 

COMPARISONS  WITH  TEE  NATION.     Overall,  Massachusetts  13-year-olds  outscored 
their  counterparts  nationwide  by  between  four  and  eight  percentage  points 
on  two  of  the  five  objectives,  and  scored  at  about  the  same  level  on  the 
remaining  three  objectives.  On  the  other  hand,  Massachusetts  17-year-olds 
scored  lower  than  17-year-olds  throughout  the  Nation  by  6%  to  9%   on  two  of 
the  objectives,  and  scored  at  about  the  same  level  on  the  remaining  three 
objectives.  Because  only  a  small  number  of  items  is  matched  to  each 
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FIGURE  3 
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FIGURE  4 


Comparing  Massachusetts,  the  Nation,  and  the  Northeast 

by  Objective— 17-Year-Olds 
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objective  (only  one  item  for  Objective  5  was  administered  to  both 
Massachusetts  and  NAEP  17-year-olds,  for  example),  the  reader  is  cautioned 
not  to  make  undue  generalizations. 

COMPARISONS  WITH  TEE  NORTHEAST.     Because  the  Northeast  traditionally  out- 
scores  the  Nation,  the  scores  for  students  in  the  Northeast  are  a  better 
standard  against  which  to  judge  the  performance  of  Massachusetts  students. 

Massachusetts  13-year-olds  outscored  their  counterparts  in  the  Northeast  by 
4%  on  one  objective,  scored  lower  than  students  in  the  Northeast  by  4%  to 
8%  on  two  objectives,  and  scored  at  about  the  same  level  on  the  remaining 
two  objectives.  Seventeen-year-olds  in  Massachusetts  V7ere  outscored  by 
those  in  the  Northeast  by  about  8%  on  two  objectives,  and  scored  at  about 
the  same  level  on  the  remaining  three  objectives.  The  reader  is  again 
reminded  of  the  small  number  of  items  matched  to  each  objective. 


OVERVIEW.      In  general,  the  relative  performance  of  Massachusetts  13-year- 
olds  was  stronger  than  that  of  17-year-olds.  In  addition,  the  achievement 
at  both  age  levels  was  better  in  comparison  to  the  Nation  than  to  the 
Northeast. 


COD  OBJECTIVES 

1.  Job  Characteristics:     knowledge  of  the  characteristics 
(classifications,  major  duties,  nature  of  tasks,  and 
salary)  of  various  careers  and  occupations. 

2.  Job  Requirements:     knowledge  of  the  abilities,  training, 
and  preparations  required  or  useful  for  various  careers 
and  occupations. 

3.  Career  Decision  Making:     knowledge  and  ability  necessary 
to  plan  and  implement  career  decisions. 

4.  Basic  Skills:     application  of  basic  skills  (numerical, 
communications,  and  interpersonal)  useful  in  seeking  and 
retaining  employment. 

5.  Attitudes  and  Values:     personal  attitudes  and  values 
contributing  to  career  success. 
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IV.  COMPARING  TOTAL  TEST  ACHIEVEMENT 
BY  MASSACHUSETTS  REPORTING  GROUPS 


Understanding  the  Results 

The  purpose  of  this  section  is  to  describe  and  compare  the  achievement  of 
selected  groups  of  students  within  Massachusetts.  Most  of  the  selected 
groups  are  defined  on  the  basis  of  responses  to  the  student  or  principal 
questionnaires.  Sixteen  questions  from  the  student  questionnaire,  selected 
on  the  basis  of  their  policy  relevance,  are  used  to  define  reporting  groups 
(although  some  of  these  questions  were  not  administered  to  both  age  groups) 
as  v/ell  as  three  questions  from  the  principal  questionnaire.  Results  by 
region  and  kind  of  community  are  also  reported. 

In  each  case,  the  average  for  the  reporting  group  is  compared  to  that  for 
all   students  at  that  age  level  within  Massachusetts  (the  state  average). 
The  purpose  of  these  analyses  was  to  identify  those  factors  that  bear  a 
relationship  to  student  achievement.  Achievement  is  defined  as  performance 
on  the  total  test;  that  is,  the  average  percentage  of  all   items  on  the  test 
answered  correctly  by  students  in  each  group. 

The  reader  should  note  that  the  tables  in  this  chapter  indicate  those 
differences  in  scores  that  are  statistically  significant.  However,  the 
reader  should  note  that  statistical  significance  is  not  to  be  equated  with 
educational  meaningful ness.  Small  differences  between  groups  may  be 
statistically  signifioant   in  one  case  and  not  in  another  due  to  a  variety 
of  factors,  but,  even  where  statistically  significant,  differences  may  be 
too  small  to  be  educationally  meaningful.  What  is  educationally  meaningful 
depends  on  the  reader's  judgment  about  the  practical  implications  of  given 
differences  in  scores. 

Further,  the  reader  is  cautioned  to  refrain  from  drawing  cause-effect 
inferences  from  these  data.  The  differences  observed  suggest  only  a 
relationship   between  a  given  factor  and  achievement,  not  a  causative 
influence   of  the  factor  on  achievement. 


Results  by  Region  and  Kind  of  Community 

AVERAGE  ACEIEVEMEBT.      Figures  5  and  6  display  average  performance   by  region 
and  kind  of  community,  respectively.  At  both  age  levels,  Big-City  students 
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FIGURE  5 


Achievement  on  Total  Test  by  Region 
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FIGURE  6 


Achievement  on  Total   Test  by  Kind  of  Community 
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performed  up  to  1%   below  the  statewide  average,  while  students  in 
Residential  Suburbs  exceeded  the  statewide  average  by  3%.  The  scores  of 
students  in  Industrial  Suburbs  and  Other  places  did  not  differ  significantly 
from  statewide  scores. 

At  both  age  levels,  differences  between  respective  regions  and  the  state 
average  were  generally  n^t^j   small.  The  only  exception  was  found  in  Region 
3,  the  Pittsfield  Region,  where  both  13-  and  17-year-olds  outperformed 
students  statewide  by  a  small  but  statistically  significant  margin.  The 
reader  is  reminded  that  each  of  the  regions  comprises  a  fairly  large  area, 
as  shown  on  the  map  on  page  4.  For  example,  Region  1  consists  of  many 
communities  outside  of  Greater  Boston. 


DISTRIBUTION  OF  RESPOl^SES.     Tables  7  and  8  display  the  distribution  of 
percent  correct   across  the  state  and  in  each  region  and  kind  of  community. 
Across  the  state  and  in  each  region,  over  half  of  the  13-year-olds  answered 
correctly  between  61%  and  80%  of  all  items  on  the  test.  Most  of  the  other 
students  answered  correctly  between  41%  and  60%  of  the  items.  Similar 
results  were  found  across  the  four  kinds  of  communities,  except  in  Big  Cities, 
where  more  students'  scores  fell  in  the  middle  range.  ^^r)i   few  students  in 
any  group  answered  correctly  more  than  80%  or  less  than  40%  of  the  items. 

Between  62%  and  75%  of  17-year-olds  answered  correctly  61-80%  of  the  test 
items,  while  12%  to  28%  of  them  answered  correctly  81-100%  of  the  items. 
There  were  no  major  differences  according  to  regional  or  community  group. 


Results  for  Additional  Reporting  Variables 

The  average  performance  of  each  of  the  remaining  reporting  groups  defined 
by  questionnaire  responses  are  presented  in  Table  9. 

SEX  OF  STWEm.     At  both  age  levels,  females  perfomed  slightly  above  the 
statewide  average,  while  males  performed  slightly  below,  with  differences 
not  exceeding  2%. 

ATTITUDE  TOWARD  SCHOOL.     There  was  a  general  trend  at  each  age  level  for 
performance  to  improve  as  the  student's  reported  attitude  toward  school 
became  more  positive.  Those  who  "strongly  dislike"  school  performed  lower 
than  the  state  average  by  5%.  About  50%  of  17-year-olds  and  42%  of  13-year- 
olds  reported  "liking"  or  "strongly  liking"  school,  while  16-19%  of  both  age 
groups  "dislike"  or  "strongly  dislike"  school. 
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TABLE  7 


Distribution  of  Total  Test  Score  by  Reporting  Group 
for  Massachusetts  13-Year-Olds 


Reporting  Groups 

Percentage  of 

Stuc 

ients 
Foil 

with 
Dwi  ng 

Achievement  Scores 
Ranges: 

in  the 

0-20% 

21-40% 

41-6C 

0/ 
10 

51-80% 

81 

-100% 

ALL  STUDENTS 

0 

4 

34 

60 

1 

REGION: 

1.  Boston 

2.  Northeast 

3.  Pittsfield 

4.  Southeast 

5.  Springfield 

6.  Central   Mass. 

1 
1 

0 
0 

0 
0 

6 

4 
2 
3 
6 
4 

31 
35 
30 
40 
35 
31 

61 
59 
57 
56 
57 
64 

2 
1 
1 
2 

2 

1 

KIND  OF  COMMUNITY: 

1.  Big  Cities 

2.  Industrial    Suburbs 

3.  Residential   Suburbs 

4.  Other  Communities 

1 
1 

0 
0 

10 
3 
2 

4 

49 
33 
24 
37 

39 
51 
72 
58 

1 
2 
2 

1 

TABLE  8 

Distribution  of  Total  Test  Score  by  Reporting  Group 
for  Massachusetts  17-Year-Olds 


Percentag 

e  of 

Students 

with 

Achievement  Scores 

in  the 

Reporting  Groups 

Foil 

owing 

Ranges: 

0-20% 

21-40% 

41-60% 

61-80% 

81-100% 

ALL  STUDENTS 

0 

1 

10 

Sd 

20 

REGION: 

1.'     Boston 

2.  Northeast 

3.  Pittsfield 

4.  Southeast 

5.  Springfield 

6.  Central  Mass. 

1 

0 
0 
0 
0 
0 

3 
0 
0 
0 
2 
1 

13 
8 
6 

11 
8 
8 

62 
67 
72 
72 
70 
75 

21 
24 
23 
17 
21 
15 

KIND  OF  COMMUNITY: 

1.  Big  Cities 

2.  Industrial   Suburbs 

3.  Residential   Suburbs 

4.  Other  Communities 

2 

0 
0 
0 

4 

1 
0 
0 

18 

16 

4 

10 

64 
69 
68 
75 

12 
14 
28 
15 
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TABLE  9 

Achievement  by  Student  and  Principal 
Questionnaire  Reporting  Groups 


Reporting  Group 

Average  Percer 
Total  Test  An 

itage  of  Items  on 
swered  Correctly 

13-Year-Olds 

17-Year-Olds 

ALL  STUDENTS 

62 

72 

SEX: 

Male 
Female 

61* 
63* 

71* 
73* 

HOW  DO  YOU  FEEL  ABOUT  SCHOOL? 

Strongly  dislike 

Dislike 

OK 

Like 

Strongly  like 

57* 
59* 
61* 
64* 
61 

67* 
70* 
70* 
75* 
74 

HAVE  YOU  DISCUSSED  CAREER  PLANS 
WITH  A  GUIDANCE  COUNSELOR? 

Yes 
No 

61 
62* 

74* 
70* 

HOW  MANY  TIMES  THIS  YEAR  HAVE  YOU 
DISCUSSED  CAREER  PLANS  WITH  A 
COUNSELOR?** 

None 

Once  or  twice 

Three  or  more  times 

Don't  know  or  there  is  no  counselor 

69* 
73* 
75* 
65* 

*  Represents  significant  difference  in  score  between  students  who  selected 

this  response  and  statewide  average. 
**  Question  not  asked  of  13-year-olds. 
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TABLE  9  (continued) 


Reporting  Group 

Average  Percer 
Total  Test  An 

itage  of  Items  on 
swered  Correctly 

13-Year-Olds 

17- 

■Year-Olds 

HAVE  YOU  DISCUSSED  CAREER  PLANS 
WITH  A  PARENT? 

Yes 
No 

62* 
60* 

73* 
69* 

HAVE  YOU  DISCUSSED  CAREER  PLANS 
WITH  A  FRIEND? 

Yes 
No 

62 
62 

73* 
69* 

HAVE  YOU  DISCUSSED  CAREER  PLANS 
WITH  A  PERSON  IN  AN  INTERESTING 

JOB? 

Yes 
No 

61* 
63* 

72 
72 

HAVE  YOU  DISCUSSED  CAREER  PLANS 
WITH  A  TEACHER? 

Yes 
No 

61 
62 

74* 
71* 

HOW  MUCH  ARE  YOUR  PARENTS  INVOLVED 
IN  YOUR  SCHOOLWORK? 

Hardly  at  all 
Only  a  little 
Quite  a  bit 
A  lot 

59* 

62 

63* 

61 

71* 
72 
72 
73 

DO  YOU  WANT  A  PROFESSIONAL  OR 
MANAGERIAL  TYPE  OF  JOB? 

_ 

Yes 

No 

I  don't  know 

63* 

60* 
62 

73* 
70* 
72 

*  Represents  significant  difference  in  score  between  students  who  selected 
this  response  and  statewide  average. 
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TABLE  9  (continued) 


Reporting  Group 

Average  Percentac 
Total  Test  Answe 

je  of  Items  on 
red  Correctly 

13- 

■Year- 

-Olds 

17- 

■Year-Olds 

DO  YOU  WANT  A  JOB  AS  A  SKILLED  LABORER 
OR  AS  A  SALESPERSON? 

Yes 

No 

I  don't  know 

59* 
63* 

63 

68* 
74* 
73 

DO  YOU  WANT  A  JOB  WHICH  REQUIRES 
SEMI-  OR  UNSKILLED  LABOR? 

Yes 

No 

I  don't  know 

56* 
63* 
60* 

65* 
73* 
69* 

HOW  MUCH  DO  YOUR  PARENTS  WANT  YOU  TO 

GO  TO  SCHOOL  OR  COLLEGE  AFTER  HIGH  SCHOOL? 

Hardly  at  all 
Only  a  little 
Quite  a  bit 
A  lot 

55* 
59* 
62 
64* 

66* 
67* 
72 
75* 

WHAT  ARE  YOUR  PLANS  AFTER  HIGH  SCHOOL? 

Full-time  job  or  armed  services 
Full-time  job  and  night  school 
Specialized  training  (e.g.,  nursing, 

technical,  or  business  school) 
2-year  or  community  college 
4-year  college 
Haven' t  decided 

58* 
52* 

61 

61 

66* 

59* 

66* 
68* 

69* 

72 

77* 
68* 

HAVE  YOU  EVER  PARTICIPATED  IN  A  WORK- STUDY, 
FLEXIBLE  CAMPUS,  SHARED  EXPERIENCE,  OR 
STUDENT  INTERNSHIP  PROGRAM?** 

Yes 
No 

69* 
73* 

*  Represents  significant  difference  in  score  between  students  who  selected 
this  response  and  statewide  average. 
**  Question  not  asked  of  13-year-olds. 
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TABLE  9  (continued) 


Reporting  Group 

Average  Percer 
Total  Test  An 

tage  of  Items  on 
swered  Correctly 

13- 

-Year-Olds 

17-Year-Olds 

IN  WHICH  TYPE  OF  PROGRAM  OR  CURRICULUM 
ARE  YOU  NOW  ENROLLED?** 

General 
Vocational 
College-bound 
Business  or  commercial 
Don't  know 

69* 
65* 
77* 
68* 
64* 

IS  YOUR  SCHOOL  AN  ESEA  TITLE  I  SCHOOL?t 

Yes 
No 

60* 
63* 

71 
73 

HOW  WOULD  YOU  RATE  PARENTAL  SUPPORT  OF 
YOUR  SCHOOL'S  POLICIES  AND  PROCEDURES?t 

Excellent 

Good 

Average 

Fair 

Poor 

63 

63* 

59* 

59 

50* 

74 
72 
71 
71 
67* 

HOW  WOULD  YOU  RATE  THE  ATTITUDES  OF  YOUR 
STUDENTS  TOWARD  SCHOOL  AND  LEARNING?"^ 

Excellent 

Good 

Average 

Fair 

Poor 

63 
63* 
58* 
62 

74 

74* 

70 

65* 

65* 

*  Represents  significant  difference  in  score  between  students  who  selected 

this  response  and  statewide  average. 
**  Question  not  asked  of  13-year-olds. 
t  Principal  questionnaire  item. 
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DISCUSSIONS  ABOUT  CAREER  PLANS 


Discussions  with  guidance  counselor:     At  the  17-year-old  level  only, 
those  students  who  have  discussed  career  plans  with  a  guidance  counselor 
outperformed  those  who  have  not.  The  percentage  of  students  who 
reported  talking  to  a  guidance  counselor  increased  from  24%  among  the 
13-year-olds  to  61%  for  the  17-year-olds.  Further,  among  17-year-olds 
who  have  talked  to  counselors  within  the  past  year,  performance  increased 
with  frequency  of  such  consultations. 


Discussions  with  parents:     Students  who  reported  discussing  their  career 
plans  with  a  parent  tended  to  perform  more  highly  than  those  who  have 
not.  The  difference  in  scores  was  larger  among  17-year-olds  (4%)  than 
among  13-year-olds  (2%).  At  both  age  levels,  about  nine  out  of  10 
students  reported  having  had  such  discussions. 


Discussions  with  friends:     Among  17-year-olds  only,  those  who  have 
talked  with  friends  about  career  plans  outperformed  those  who  have  not. 
About  eight  of  every  10  students  in  both  age  groups  indicated  that  they 
have  had  these  discussions  with  friends. 


Discussions  with  a  person  in  a  job  of  interest:     At  the  13-year-old 
level  only,  those  who  reported  that  they  have  talked  with  a  person  in  a 
job  of  interest  to  them  slightly  outperformed  those  who  have  not.  More 
17-year-olds  than  13-year-olds  (47%  versus  34%)  indicated  that  they  have 
done  so. 


•  Discussions  with  teachers:     Achievement  scores  were  not  related  to 
whether  or  not  13-year-old  students  reported  discussing  their  career 
plans  with  a  teacher.  Seventeen-year-olds  who  indicated  that  they  have 
spoken  to  a  teacher  about  their  future  career  plans  scored  slightly 
higher  than  the  statewide  average,  while  those  who  reported  that  they 
have  not  had  such  discussions  scored  slightly  below  the  state.  More 
than  twice  as  many  17-year-olds  as  13-year-olds  (37%  versus  15%)  have 
talked  with  a  teacher  about  career  plans. 

PARENTAL  INVOLVEMENT.      In  both  age  groups,  students  vyho  reported  that  their 
parents  were  involved  in  their  schoolwork  "hardly  at  all"  scored  slightly 
below  the  statewide  average.  The  differences,  however,  were  3%  at  the  13- 
year-old  level  and  only  1%  at  the  17-year-old  level.  More  17-year-olds 
(18%)  than  13-year-olds  (11%)  reported  that  their  parents  were  "hardly  at 
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all"  involved,  while  48%  of  the  older  students  and  61%  of  the  younger  ones 
reported  "quite  a  bit"  or  "a  lot"  of  parental  involvement. 


FUTURE  PLANS 


Career  aspirations:     At  both  age  levels,  the  relationship  between  career 
aspirations  and  achievement  was  the  same.  Students  who  indicated  that 
they  would  like  to  have  a  job  that  could  be  described  as  "professional" 
or  "managerial"  performed  slightly  above  the  statewide  average,  while 
those  who  indicated  that  they  would  like  to  have  a  middle-level  ("sales" 
or  "skilled  labor")  or  lov;-level  ("semi-skilled"  or  "unskilled")  job 
scored  below  the  statewide  average.  A  little  more  than  half  of  the 
students  at  each  age  level  indicated  that  they  aspired  to  a  professional 
or  managerial  job.  Almost  a  third  wanted  a  middle-level  job,  and  about 
10%  aspired  to  "semi-"  or  "unskilled"  jobs. 


Parental  encouragement  to  continue  schooling:     At  both  age  levels,  there 
was  a  strong  tendency  for  performance  to  improve  with  the  increased 
emphasis  placed  by  parents  on  postsecondary  education.  Students  whose 
parents  wanted  them  to  continue  schooling  after  high  school  "only  a 
little"  or  "hardly  at  all"  scored  below  the  statewide  average  by  3-7%, 
while  students  whose  parents  encouraged  them  "a  lot"  scored  higher  than 
the  state  by  2-3%.  Between  20%  and  23%  of  the  students  in  each  age 
group  reported  that  their  parents  wanted  them  to  continue  their 
education  after  high  school  "only  a  little"  or  "hardly  at  all,"  compared 
to  76-80%  whose  parents  encourage  them  "quite  a  bit"  or  "a  lot." 


Post-high- school  plans:     At  both  age  levels,  students  who  reported  that 
they  plan  to  attend  a  four-year  college  scored  4-5%  higher  than  the 
statewide  average,  vyhile  those  who  plan  on  a  full-time  job  or  on 
combining  school  with  a  full-time  job  scored  4-10%  lower  than  the 
students  statewide.  At  both  age  levels,  41%  of  the  students  plan  to 
attend  four-year-college,  while  12-19%  plan  on  full-time  jobs  or 
combining  jobs  and  school.  Further,  31%  of  13-year-olds  and  18%  of  17- 
year-olds  have  not  yet  decided  on  post-high-school  plans. 


CURRENT  PROGRAM  ENROLLMENT 


Participation  in  work-study  and  other  programs:     Seventeen-year-olds 
were  asked  if  they  had  ever  participated  in  a  work-study,  flexible 
campus,  shared  experience,  or  student  internship  program.  Those  who 
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responded  "yes"  scored  belov;  the  statewide  average  by  3%.  Only  18%  of 
17-year-olds  reported  that  they  have  at  some  time  participated  in  a 
work-study  or  related  program. 


Present  high  school  program:     At  the  17-year-old  level,  students  who 
indicated  that  they  were  enrolled  in  a  college-bound  program  scored  5% 
higher  than  the  statewide  average,  V7hile  students  who  said  they  were 
enrolled  in  a  general,  vocational,  or  business  program  scored  3-7% 
lower  than  the  statewide  average.  Just  over  half  of  the  students  (53%) 
reported  that  they  were  in  college-bound  programs,  and  approximately 
13%  of  the  students  indicated  that  they  were  enrolled  in  each  of  the 
other  types  of  programs. 


PRINCIPAL  QUESTIONNAIRE  VARIABLES 


School  participation  in  ESEA  Title  I  program:      At  the  13-year-old  level 
only,  students  in  schools  which  receive  ESEA  Title  I  funds  performed 
slightly  below  the  state  average,  while  those  in  non-Title  I  schools 
scored  slightly  above  the  state  average.  At  the  17-year-old  level, 
there  was  no  significant  difference  between  either  of  these  groups  and 
the  statewide  average.  Just  under  half  of  all  principals  replied  that 
their  schools  participated  in  the  ESEA  Title  I  program. 


Parental  support  of  the  school:     At  both  age  levels,  students  whose 
principals  reported  that  parental  support  of  the  school  is  "average," 
"fair,"  or  "poor"  performed  less  well  than  those  whose  principals 
reported  parental  support  as  "good"  or  "excellent."  Approximately 
three  of  ey^ry   four  principals  rated  parental  support  of  their  schools 
as  "good"  or  "excellent,"  while  very   few  (5%  and  10%  of  principals  of 
13-  and  17-year-olds,  respectively)  rated  parental  support  as  either 
"fair"  or  "poor." 


Stvdent  attitude  toward  school:     At  the  17-year-old  level,  students 
whose  principals  rated  student  attitude  as  generally  "fair"  or  "poor" 
scored  7%  below  the  state  average,  while  those  whose  principals  rated 
attitudes  more  favorably  tended  to  perform  more  highly.  Results  were 
not  as  clearcut  at  the  13-year-old  level.  However,  N^vy   few  principals 
(2-8%)  chose  the  "fair"  or  "poor"  rating,  while  about  70%  chose  ratings 
of  "good"  or  "excellent." 
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COMPARISONS  BETWEEN  VOCATIONAL  STUDENTS.     The  Division  of  Occupational 
Education  of  the  MDE  requested  a  comparison  of  the  test  performance  of  those 
17-year-olds  enrolled  in  vocational  programs  in  regular  and  regional 
academic  high  schools  with  the  performance  of  17-year-olds  enrolled  in 
vocational  programs  in  regional  vocational-technical  schools.  Additional 
test  administrations  were  conducted  to  insure  that  a  sufficient  number  of 
students  from  each  category  were  represented.  Including  the  "oversampled" 
students  and  the  regular  statewide  sample,  there  were  a  total  of  175 
vocational  students  in  academic  high  schools  and  398  vocational  students  in 
regional  vocational -technical  schools. 

The  results  are  quite  straightforward.  The  average  achievement  performance 
on  the  total  test  was  the  same  for  the  two  groups.  Furthermore,  the 
difference  in  achievement  on  each  of  the  five  objectives  was  smaller  than 
1%  in  each  case. 
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V.  ADDITIONAL  HIGHLIGHTS  OF  THE  PRINCIPAL 


AND  STUDENT  QUESTIONNAIRES 


Introduction 


In  addition  to  an  analysis  of  those  questionnaire  variables  which  were  shown 
in  Section  IV  to  bear  a  relationship  to  achievement,  an  examination  of  the 
responses  to  additional  questionnaire  responses  may,  in  itself,  provide  a 
policy-relevant  characterization  of  students,  principals,  and  schools 
throughout  Massachusetts.  Highlights  of  these  questionnaire  responses  are 
presented  below  along  with  a  profile  of  the  outstanding  differences  between 
students  in  Big  Cities  and  Residential  Suburbs.  Other  questionnaire  items 
that  were  judged  by  the  Committee  to  lack  policy  relevance  are  detailed  in' 
the  Technical  Report. 


Highlights  of  the  Principal  Questionnaire 


OBJECTIVE-REFERENCED  INSTRUCTION.     Principals  were  asked  to  rank  order  the 
objectives  assessed  by  the  test  in  terms  of  instructional  emphasis  in  their 
schools  and  to  indicate  their  satisfaction  with  student  achievement  on  each 
one. 

Considering  the  five  objectives  as  ranked  from  1  =  highest  to  5  =  lowest 
emphasis,  the  objectives  were  ranked,  on  the  average,  by  principals  as 
follows: 


High  School  Principals 


Middle  School  Principals 


1.  Knowledge  of  Job  Requirements  1. 

2.  Basic  Skills  2. 

3.  Attitudes  and  Values  3. 

4.  Career  Decision  Making  4. 

5.  Knowledge  of  Job  5. 
Characteristics 


Attitudes  and  Values 

Knowledge  of  Job  Requirements 

Basic  Skills 

Career  Decision  Making 

Knowledge  of  Job 

Characteristics 


Between  66%  and  69%  of  high  school   principals  were  either  "satisfied"  or 
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''Mery   satisfied"  with  achievement  on  Attitudes  and  Values  and  Basic  Skills, 
while  only  54-56%  felt  this  way  with  regard  to  the  other  three  objectives. 
This  discrepancy  was  even  more  substantial  at  the  middle  school  level,  where 
62-70%  were  satisfied  to  some  degree  about  Attitudes  and  Values  and  Basic 
Skills  but  only  36-46%  felt  the  same  way  about  the  other  three  objectives. 


WAYS  TO  IMPROVE  THE  CAREER  EDUCATION  PROGRAM j     Principals  were  asked  to 
cite  two  major  ways  in  which  the  career  education  programs  in  their  schools 
could  be  improved.  Principals  tended  to  select  answers  which  favored  the 
integration  of  career  education  into  the  regular  curriculum,  rather  than 
the  separation  of  such  instruction  from  students'  day-to-day  school 
experience.  About  60%  of  all  principals  advocated  "more  infusion  of  career 
education  into  the  curricula  of  other  courses,"  and  about  40%  desired  "more 
inservice  training  for  academic  teachers  regarding  career  education."  Just 
under  20%  of  principals  of  17-year-olds  indicated  a  need  for  more  guidance 
or  career  counseling  personnel,  more  career  classes,  and  more  innovative 
methods;  slightly  more  principals  of  13-year-olds  cited  these  needs.  In 
addition,  19%  of  middle  and  junior  high  school  principals  and  11%  of  high 
school  principals  cited  a  need  for  more  inservice  training  of  guidance  staff 
in  career  education. 


MINIMUM  ACHIEVEMENT  STANDARDS.     At  both  age  levels,  more  than  three  out  of 
four  principals  responded  "Yes"  to  the  question:  "Do  you  believe  that  all 
students  must  meet  some  specified  minimum  standard  of  achievement  in 
reading,  writing,  and  mathematics  as  one  requirement  for  the  awarding  of 
the  high  school  diploma?"  (79%  and  76%  for  principals  of  13-  and  17-year- 
olds,  respectively). 

The  overwhelming  majority  of  principals  felt  that,  if  minimal  competency 
standards  were  to  be  used  as  a  basis  for  high  school  graduation,  the  local 
educational  agencies  should  have  some   responsibility  for  setting  those 
standards.  About  one-third  of  all  principals  felt  that  the  responsibility 
should  rest  solely  with  local  educational  agencies,  v/hile  another  50% 
replied  that  the  local  agencies  and  the  State  Board  of  Education  should 
share  that  responsibility  jointly.  Only  about  9%  of  the  principals  at  both 
age  levels  replied  that  the  State  Department  of  Education  should  have  sole 
responsibility  for  setting  standards,  and  only  1%  of  the  principals 
indicated  that  the  stage  legislature  should  set  minimal  competency  standards 


SCHOOL  ATTENDANCE.     Almost  83%  of  the  middle  school  principals  reported 
that  their  schools  have  an  average  first-quarter  attendance  rate  of  91%  or 
better,  but  only  69%  reported  this  high  a  rate  for  the  second  quarter.  At 
the  high  school  level,  77%  of  the  principals  reported  first-quarter 
attendance  at  91%  or  above,  while  just  under  a  half  reported  the  same 
attendance  for  the  second  quarter. 
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AVAILABILITY  OF  CAREER  COURSES.       About  three-quarters  of  principals  of  17- 
year-olds  responded  that  career  courses  were  "generally"  available  at  their 
schools,  while  another  18%  said  that  these  courses  were  "somewhat" 
available.     (This  question  was  not  asked  of  principals  of  13-year-old 


students.) 


Highlights  of  the  Student  Questionnaire 

CAREER  APTITUDE  TESTS.     A  sizable  proportion  of  students  at  each  age  level 
indicated  that  they  had  never  taken  a  test  designed  to  help  them  decide  on 
their  career  plans  (53%  of  13-  and  37%  of  17-year-olds).  Furthermore, 
about  12%  of  13-year-olds  and  23%  of  the  17-year-olds  did  not  know  whether 
or  not  they  had  ever  taken  such  a  test. 


USEFULNESS  OF  FIELD  TRIPS.     Almost  nine  of  every   10  students  replied  that 
school -sponsored  field  trips  taught  them  things  that  are  useful  for  them 
to  know. 


USEFULNESS  OF  SCHOOLING.     Most  students  reported  feeling  that  their  school- 
ing has  been  "somewhat"  or  "very"   useful  in  helping  them  to  fulfill  their 
career  objectives.  Only  12%  and  16%  of  the  13-year-olds  and  17-year-olds, 
respectively,  replied  that  school  has  been  "not  very   useful"  in  this 
respect. 


CERTAINTY  ABOUT  CAREER  ASPIRATIONS.     At  both  age  levels  78%  of  the  students 
reported  that  they  were  either  "very   sure"  or  "somewhat  sure"  about  the 
kind  of  job  that  they  would  like  to  have  in  the  future. 


VOLUNTEER  WORK.     Among  17-year-olds,  30%  indicated  that  they  have,  at  some 
time,  done  volunteer  v/ork  in  a  career  area  of  possible  interest  to  them. 


Profile  of  Students  and  Schools  in  Big  Cities 

Results  reported  earlier  indicated  that  Big-City  students  tended  to  score 
below  the  statewide  average,  while  students  in  Residential  Suburbs  tended 
to  score  above  the  statewide  average.  An  attempt  was  made  to  identify 
characteristics  of  Big-City  Schools  that  may  contribute  to  differential 
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assessment  in  comparison  to  students  in  Residential  Suburbs.  The  resultant 
"profile,"  based  on  responses  to  the  principal  and  student  questionnaires, 
is  presented  below. 

In  comparison  to  Residential  Suburbs,  Big  cities   are  places  in  which: 

the  proportion  of  17-year-olds  in  the  ninth  or  tenth  grade  is 
larger. 

students  are  likely  to  be  given  drill  work  or  reading  and  writing 
assignments  less  frequently. 

13-year-olds  are  more  likely  to  discuss  their  career  plans  with  a 
guidance  counselor,  while  17-year-olds  are  less  likely  to  do  so. 

17-year-olds  are  less  likely  to  have  taken  a  career  aptitude  test. 

a  larger  proportion  of  parents  of  school -age  children  work  in  low- 
status  occupations. 

students  are  less  likely  to  aspire  to  high-status  occupations. 

parents  of  17-year-olds  are  less  likely  to  encourage  postsecondary 
education. 

students  are  less  likely  to  plan  on  attending  a  four-year  college. 

a  larger  proportion  of  17-year-olds  are  enrolled  in  vocational 
programs  and  participate  in  work-study  programs. 

principals  are  less  likely  to  encounter  "excellent"  or  "good" 
parental  support  of  the  school  and  student  attitudes  toward  school. 

the  average  attendance  rate  in  each  quarter  tends  to  be  lower. 
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VI.   INTERPRETATIONS  AND  RECOMMENDATIONS 


Introduction 


This  section  of  the  report  contains  an  analysis  and  interpretation  of  the 
findings  of  the  Assessment  and  a  set  of  recommendations  based  on  those 
findings.  The  work  of  interpreting  the  results  was  the  responsibility  of 
the  Career  and  Occupational  Development  Technical  Committee.  The 
recommendations  developed  by  the  Committee  are  appropriate  to  several 
audiences,  including,  but  not  limited  to,  teachers,  guidance  personnel, 
local  administrators,  curriculum  planners,  and  state-level  decision-makers. 


The  Context:  The  Committee's  View  of  the  Findings 

The  findings  were  viewed  by  the  Committee  as  constituting  baseline 
information  about  the  Career  skills  and  knowledge  of  Massachusetts  students 
on  the  five  high-priority  learning  objectives.  The  Committee  imbedded 
their  interpretations  and  recommendations  in  the  context  of  their  pro- 
fessional ex-peetations   for  students  statewide  in  consideration  of  the 
particular  group  of  items  for  each  objective.  In  addition,  they  utilized 
the  input  of  the  Benchmark  Panel  described  earlier  (see  p.  7),  where 
consensus  (at  least  two-thirds  agreement  among  panel  members)  was  achieved. 

The  reader  should  bear  in  mind  that  the  same  test  was  administered  at  both 
age  levels.  This  duplication  permitted  a  comparison  of  the  achievement  of 
each  age  group  on  each  item  and  objective.  Given  these  comparisons,  it  was 
hoped  that  achievement  would  increase  as  the  age  level  increased.  Where 
substantial  increases  did  not  occur,  this  information  is  useful  for 
instructional  planning  because  it  serves  as  one  indication  that  a  particular 
skill  is  not  uniformly  reinforced  or  developed  at  the  high  school  level. 

The  reader  should  also  note  that,  in  evaluating  student  performance,  the 
Committee's  focus  was  always  on  strengths  and  weaknesses  of  a  given  age 
group  across  the  objectives  tested  at  that  level.  Within  this  context,  the 
Committee  made  interpretive  comments  on  performance  which  fell  short  of 
expectations  or  which  met  or  exceeded  expectations.  While  most  recommend- 
ations are  based  on  perceptions  of  v/eaknesses  in  students'  skills,  the 
Committee  emphasized  that  the  observed  strengths  should  not  be  overlooked. 
In  particular,  areas  which  showed  high  performance  by  students  should 
continue  to  receive  the  same  quality  of  instructional  and  curricular  effort 
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in  order  to  maintain  students'  strengths  in  these  areas. 

References  made  to  specific  test  items  are  made  in  the  analyses  that  follow. 
Each  of  these  items  is  described  in  Appendix  B  (p.  55  )  along  with  the 
percentage  of  students  answering  correctly. 


Objective  I:  Knowledge  of  Job  Characteristics 

The  Committee  was  generally  satisfied  with  the  performance  of  13-year-olds 
on  this  objective  (60%  correct)  especially  in  relation  to  national  achieve- 
ment, but  was  not  impressed  by  the  performance  of  17-year-olds  (68% 
correct)  in  comparison  to  13-year-olds.  The  improvement  in  NAEP  item 
scores  from  the  13-  to  the  17-year-old  level  was  greater  in  the  Nation  and 
Northeast  than  in  Massachusetts.  While  there  was  interest  in  maintaining 
the  strengths  among  13-year-olds  through  continued  program  emphasis,  a 
concern  was  raised  that  additional  emphasis  at  the  high  school  level 
appears  to  be  required. 

Because  it  was  the  consensus  of  the  Benchmark  Panel  participants  that 
approximately  three-quarters  of  the  items  for  this  objective  do  not  require 
additional  emphasis  in  instruction,  the  Committee  focused  primarily  on  the 
five  items  that  were  seen  as  needing  attention  (#5,  #39,  #40,  #41,  and  #56). 
Consideration  of  the  skills  measured  by  these  items  resulted  in  the  con- 
clusion that  students  need  to  be  made  more  aware  of  (a)  the  vocabulary  used 
in  job  titles  to  describe  various  types  of  occupations,  (b)  the  commonal- 
ities in  the  characteristics  of  jobs  within  each  occupational  cluster, 
(c)  the  educational  requirements  and  benefits  of  given  jobs  within  each 
cluster,  and  (d)  the  nature  of  interpersonal  responsibilities  common  and 
unique  to  various  types  of  occupations. 

In  addition,  it  was  noted  that  there  were  considerable  differences  between 
the  performance  of  male  and  female  students  on  a  number  of  items  (e.g.,  #8, 
#9,  and  #40).  It  appeared  that  a  larger  proportion  of  males  tended  to  know 
the  characteristics  of  traditionally  "male"  jobs,  while  more  females  knew 
the  characteristics  of  traditionally  "female"  jobs.  It  was  concluded  that 
stereotyping  of  occupations  according  to  male  and  female  roles  must 
continue  to  be  attacked  by  teaching  and  counseling  personnel. 

Because  the  Committee  was  aware  of  the  tremendous  range  and  variety  of 
occupations  in  the  world  of  work,  they  were  sensitive  to  the  limitations 
on  time  and  resources  in  providing  students  information  about  job 
characteristics.  Therefore,  the  process   of  finding  information  about  jobs 
was  viewed  as  a  critical  focus  of  career  education.  It  was  considered  most 
important  that  students  are  made  aware  that  career  development  and  decision 
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making  are  lifelong  processes,  especially  given  the  constantly  changing  job 
market  and  the  need  to  consider  mid-life  career  changes  and  retirement 
plans.  Thus,  knowing  how   to  find  information  about  jobs  is  important  both 
now  and  later  in  their  lives.  In-school  programs,  given  the  time 
available,  should  focus  on  major  occupations  within  each  cluster;  and  these 
should  include  the  less  visible,  or  "hidden"  occupations  (e.g.,  "machinist") 
as  well  as  emerging  occupations. 


RECOMMENDATIONS 

1.  Continue  to  maintain  the  standing  of  students  at  the 
middle  level  relative  to  national  norms  by  providing 
career  education  programs  that  ensure  basic  occupat- 
ional knowledge  among  pre-13-year-olds. 

2.  Increase  efforts  directed  at  developing  and  strength- 
ening career  education  programs  at  the  secondary  level 
in  order  to  provide  high  school  students  with  knowledge 
of  a  broad  range  of  occupations  and  their  character- 
istics. 

3.  Within  the  context  of  a  stronger  career  education  effort 

a)  increase  students'  awareness  of  the  major 
occupational  clusters  and  their  knowledge 
of  the  primary  job  types  and  titles  within 
each. 

b)  ensure  that  the  range  of  jobs  covered  includes 
emerging  and  less  visible  occupations. 

c)  increase  the  emphasis  on  instruction  related 
to  the  -process   of  finding  out  information 
about  jobs,  including  use  of  economic  fore- 
casts and  the  Occupational  Outlook  Handbook. 

4.  Provide  for  increased  concentration  on  the  elimination 
of  sex  stereotyping  within  career  education  programs  by 
increasing  the  knowledge  of  both  sexes  about  the 
characteristics  of  jobs  not  traditionally  open  to  them. 

a)  continue  to  attack  the  traditional  barriers 
that  exist  for  sex-linked  occupations. 
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5. 


RECOMMENDATIONS  (continued) 

b)  increase  efforts  to  acquaint  women  with 
occupations  that  are  emerging  and  there- 
fore still  sex-neutral  or  sex-mixed 
(e.g.,  environmental  technology). 

Encourage  career  professionals  to  ensure  that  their 
programs  and  services  are  preparing  women  for  jobs 
on  the  assumption  that  they  are  likely  to  be  primary 
(rather  than  marginal)    wage  earners. 


Objective  II:  Knowledge  of  Job  Requirements 


On  this  objective,  the  Committee  v/as  again  satisfied  with  the  performance 
of  13-year-olds  (55%  correct),  but  concerned  that  the  performance  of  17- 
year-olds  (68%  correct)  was  not  stronger  to  the  extent  that  might  be 
expected.   However,  while  there  were  only  a  small  number  of  items  avail- 
able for  comparison,  the  Committee  was  satisfied  that  Massachusetts 
students  of  both  ages  performed  comparably  with  their  national  and  North- 
east counterparts.  Across  the  30  items  assessing  this  objective,  it  was 
the  consensus  of  the  Benchmark  Survey  that  approximately  30%  at  the  13- 
year-old  level  and  15%  at  the  17-year-old  level  required  additional 
emphasis. 

Of  primary  concern  was  the  fact  that  on  a  number  of  items  (e.g.^  #27-35, 
and  #54),  students  appear  to  be  overestimating  the  education  or  training 
required  for  given  jobs.  Given  this  trend,  the  Committee  was  concerned  to 
caution  career  education  professionals  against  "overselling"  higher 
education  regardless  of  individual  student  needs  and  abilities.  For 
example,  just  over  half  of  the  13-year-olds  were  aware  that  "apprentice- 
ship" is  the  appropriate  training  for  a  "glassblov;er"  (item  #28)  and 
"blacksmith"  (item  #32).  The  question  v;as  raised  as  to  whether  these 
students  are  av;are  of  what  constitutes  "apprenticeship." 

The  issue  of  sex  stereotyping  of  jobs  was  again  raised  in  connection  with 
this  objective.  For  example,  47%  of  male  17-year-olds  and  only  27%  of  their 
female  counterparts  were  aware  that  an  "electrician"  requires  knowledge  of 
"general"  mathematics,  while  78%  of  17-year-old  females  as  opposed  to  63% 
of  the  males  were  aware  of  the  training  required  to  be  a  "social  v/orker." 
Even  more  striking  was  the  fact  that  on  this  item,  female  achievement  was 
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lower  among  17-year-olds  than  among  13-year-olds;  it  was  hypothesized  that 
this  result  reflects  females'  "learned  ignorance"  about  a  male-dominated 
(and  financially  rewarding)  occupation  or  anxiety  about  mathematics  as  a 
barrier  to  some  career  options. 

The  Committee  therefore  reiterated  their  suggestions  regarding  an  increased 
focus  on  eliminating  sex  stereotyping  in  career  education  programs  and 
services  in  order  to  ensure  that  males  and  females  are  equally  apprised  of 
the  education  and  training  required  for  jobs  not  traditionally  open  to  them. 

Also  in  connection  with  those  items  requiring  students  to  identify  jobs 
requiring  "general"  or  "advanced"  mathematics  skills  (items  #84-88),  the 
Committee  was  concerned  about  those  cases  in  which  a  relatively  low  per- 
centage of  students  answered  correctly.  While  there  was  some  question  as 
to  whether  these  labels  for  math  skills  were  unambiguous  enough  to  be 
validly  interpreted  by  students,  the  importance  of  mathematics  ability  to 
a  wide  range  of  jobs  was  emphasized  by  the  Committee.  It  was  considered 
important  that  students  be  made  aware  of  the  need  to  develop  such  skills  in 
order  to  increase  their  employability  in  general  and  the  probability  of 
obtaining  a  desired  job  in  particular. 


1. 


2. 


RECOMMENDATIONS 

Increase  the  focus  on  teaching  students  about  the 
education  and  training  required  for  a  broad  range 
of  jobs. 

Increase  the  understanding  of  all  students,  but 
particularly  females,  of  the  importance  of  developing 
mathematics  skills  in  order  that  they  not  be  disad- 
vantaged from  obtaining  jobs  in  high  technology  trade 
and  a  variety  of  other  trades  as  well. 


Objective  III:  Career  Decision  Making 


The  Committee  was  generally  dissatisfied  with  the  overall  performance  of 
both  age  groups  on  this  objective,  since  it  represented  the  poorest 
performance  on  an  objective  by  17-year-olds  (66%  correct)  and  the  second 
poorest  among  13-year-olds  (56%).  The  Committee  therefore  agreed  with  the 
consensus  of  the  Benchmark  panel  that  this  area  is  in  most  need  of 
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additional  emphasis;  the  Benchmark  results  indicated  that  just  under  50%  of 
the  items  (a  larger  proportion  than  on  any  other  objective)  required 
additional  emphasis.  Given  the  importance  of  career  decision  making  in 
general,  the  Committee  was  particularly  concerned  that,  on  the  average>, 
students  of  both  ages  in  residential  suburbs  outperformed  those  in  big 
cities  by  10-12%  on  this  objective. 

One  item  (#4),  singled  out  to  substantiate  the  Committee's  concern  about 
performance  on  this  objective,  required  students  to  "list  five  things  to 
consider  when  choosing  a  job."  The  percentage  of  Massachusetts  13-year-olds 
(41%)  who  could  provide  five  such  things  v/as  considerably  lower  than  that 
in  the  Nation  (59%)  and  Northeast  (63%).  There  was  a  similar  negative 
discrepancy  among  Massachusetts  17-year-olds  (63%)  as  compared  to  their 
national  (85%)  and  Northeast  (87%)  counterparts  on  this  item.  By  contrast, 
slightly  more  Massachusetts  students  than  students  in  the  Northeast  region 
could  list  three  ways  (when  asked  for  five)  to  learn  more  about  a  part- 
icular job  before  taking  it. 

As  further  evidence  of  students'  weakness  in  decision-making  skills,  the 
Committee  considered  the  relatively  low  proportions  of  both  age  groups  who 
could  match  likely  career  choices  to  given  descriptions  of  hypothetical 
individuals  (e.g.,  #94,  #96,  #97,  and  #98).  The  ability  to  answer  such 
questions  correctly  was  considered  to  be  an  indication  that  students  could 
match  interests  and  abilities  to  career  choice,  and  the  Committee  was 
concerned  that  many  could  not  do  so.  It  was  also  noted  with  concern  that 
considerable  variability  in  the  percentage  of  students  who  could 
for  given  occupations,  whether  or  not  more  or  fewer  jobs  will  be 
in  the  next  ten  years  (items  #99-106).  As  noted  earlier, 
awareness  of  economic  forecasts  and  labor  market  projections  was 
to  be  important  and  worthy  of  additional  emphasis. 
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RECOMMENDATIONS 
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RECOMMENDATIONS  (continued) 

b)  Increase  the  awareness  of  career  education 
personnel  about  such  resources  as  the  Bureau 
of  Labor  Statistics  that  may  be  useful  and 
appropriate  to  developing  students'  career 
decision-making  skills. 

c)  Focus  particular  attention  on  the  needs  of 
students  in  urban  areas  regarding  the  devel- 
opment of  decision-making  skills. 


Objective  IV:  Basic  Skills 


A  number  of  items  on  the  test  assessed  basic  skills  in  the  areas  of  com- 
munications(e.g. ,  resumes,  interviews,  and  writing  envelopes),  numerical 
skills  (e.g.,  reading  graphs  and  blueprints),  and  interpersonal  skills 
(e.g.,  participating  in  group  discussions).  While  only  a  relatively  small 
number  of  items  in  these  areas  could  be  included  on  the  test,  their 
inclusion  as  indicators  of  related  student  skills  was  intended  to  convey 
the  commitment  of  the  Committee  to  the  infusion  of  career  education  into 
academic  instruction.  The  Committee  was  intent  on  pointing  out  that  all 
basic  skills  are,  in  fact,  career  skills  and  are  fundamental  to  career 
education  goals.  In  general,  they  were  pleased  that  both  age  groups  scored 
relatively  well  on  this  objective  (73%  correct  among  13-year-olds  and  83% 
correct  among  17-year-olds). 

It  was  encouraging  to  note  that  the  large  majority  of  both  13-year-olds 
(89%)  and  17-year-olds  (95%)  could  correctly  address  an  envelope  as 
instructed.  However,  on  this  and  a  number  of  other  communications  items 
assessing  skills  related  to  being  interviev/ed  (items  #66-69  and  #74), 
female  students  at  both  age  levels  outperformed  their  male  counterparts. 
The  differences  in  percentage  of  each  group  answering  correctly  ranged  from 
3-15%,  with  females  consistently  outperforming  males. 

By  contrast,  males  tended  to  outperform  females  in  both  age  groups  on  items 
assessing  numerical  skills.  More  males  than  females  could  read  the  length 
of  a  line  segment  on  a  blueprint  (items  #81  and  #82)  and  calculate  square 
footage  of  a  room  given  dimensions  on  a  blueprint  (item  #83).  These 
differences  ranged  from  6%  to  12%.  Further,  the  Committee  noted  with  some 
alarm  that  a  very   low  percentage  of  Massachusetts  students  (23%  of  13-year- 
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olds  and  35%  of  17-year-olds)  could  calculate  square  footage,  and  that 
these  proportions  were  lower  than  those  in  the  Nation  and  Northeast. 


RECOMMENDATIONS 

1.  Increase  general  awareness  that: 

a)  all  basic  skills  (language,  communications, 
numerical,  interpersonal),  are,  in  fact, 
career  education  skills. 

b)  diagnosis  of  students'  basic  skills  is  not 
only  important  but  necessary  in  order  that 
emerging  strengths  and  weaknesses  can  be 
directly  applied  to  the  employment-seeking 
process. 

2.  Increase  the  av/areness  of  all  teaching  personnel  that 
career  education  can  and  must  be  effectively  infused 
with  curricula  in  all  subject  areas  to  supplement  and 
support  career  education  services  and  programs. 

3.  Increase  the  understanding  of  administrators  that 
remediation  of  weaknesses  in  career  skills  or  expansion 
of  career  education  concepts  does  not  necessarily 
require  more  money,  time,  and  resources,  but  can  be 
addressed  by  the  restructuring  or  increased  coordina- 
tion of  all  programs  and  services  to  include  a  career 
education  focus. 

4.  Address  the  need  to  increase  the  communications  and 
interpersonal  skills  of  males  in  particular,  and  the 
mathematics  skills  of  females  in  particular. 


Objective  V:  Attitudes  and  Values 

The  items  assessing  this  objective  generally  focussed  on  students'  aware- 
ness of  the  activities,  attitudes,  and  values  that  are  likely  to  contribute 
to  success  in  the  world  of  work.  While  a  few  of  these  items  were  somewhat 
"factual"  in  nature  (e.g.,  item  #62  on  the  success  of  a  nurse  who  "gets 
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along  well  with  others"  and  item  #63  on  the  success  of  a  nurse  who  does  not 
"sacrifice  speed  for  accuracy"),  the  majority  of  items  focused  on  more 
value-laden  topics  such  as  "doing  only  what  you  are  told  to  do"  (#113)  and 
"keeping  one's  mouth  shut  in  order  to  avoid  stirring  things  up"  (#108). 
The  Committee  pointed  out  that  responses  to  the  latter  items  are  not 
justifiably  considered  "right"  or  "wrong"  but  rather  simply  indications  of 
the  extent  to  which  students  have  developed  attitudes  that  tend  to  be 
characteristic  of  successful  and  productive  workers. 

It  was  of  particular  interest  to  the  Committee  that,  across  the  items  for 
this  objective,  a  relatively  lower  percentage  of  both  age  groups  saw  the 
importance  to  success  of  such  things  as  "offering  new  ideas  in  connection 
with  one's  job"  (item  #65),  "taking  responsibility  for  one's  own  behavior" 
(item  #25),  and  taking  initiative  rather  than  "doing  only  what  one  is  told 
to  do"  (item  #113).  It  was  concluded  that,  while  jobs  vary  considerably  in 
the  extent  to  which  they  provide  opportunities  for  initiative,  for  example, 
students  should  be  made  aware  of  those  attitudes  and  values  that  would  be  , 
regarded  favorably  by  employers. 

Discussion  of  results  for  this  objective  along  with  those  for  selected 
student  questionnaire  variables  (discussed  below)  led  the  Committee  to  make 
the  following  recommendation. 


RECOMMENDATIONS 


1.  Conduct  sophisticated  research  which  explores  in-depth 
the  attitudes  and  perceptions  of  students  regarding 
such  things  as  their  feelings  about  work  and  its  import- 
ance, about  the  relationship  of  education  to  work,  and 
about  the  nature  of  factors  which  influence  their 
expectations,  aspirations,  and  decisions. 


Career  Guidance 


While  the  large  majority  of  13-  and  17-year-olds  reported  that  they  have 
talked  with  friends  and  parents  about  personal  career  plans,  a  substantial 
proportion  have  never  discussed  such  plans  with  eitherguidance  counselors 
(75%  of  13-year-olds  and  38%  of  17-year-olds),  teachers  (84%  of  13-year- 
olds  and  61%  of  17-year-olds)  or  a  person  in  a  career  of  interest  to  them 
(65%  of  13-year-olds  and  50%  of  17-year-olds).  Further,  among  13-  and  17- 
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year-olds,  only  27%  have  spoken  with  a  counselor  about  career  plans  "several 
times"  in  the  last  year.  The  Committee  expressed  concern  that  students  may 
not  be  offered  or  may  not  be  taking  adequate  opportunity  to  interact  v/ith 
qualified  professionals.  The  fact  that  those  students  who  have  talked  with 
professionals  (and  those  who  have  done  so  more  frequently)  tended  to  out- 
perform other  students  pointed  to  the  importance  of  such  interactions. 

In  addition,  while  53%  of  13-year-olds  and  37%  of  17-year-olds  reported 
"never"  having  taken  a  test  to  help  them  decide  on  career  plans,  the 
Committee  was  even  more  concerned  that  23%  and  12%  respectively  "don't 
know"  if  they  have  even  taken  such  a  test.  These  and  the  foregoing  results 
led  the  Committee  to  a  discussion  of  the  amount  of  counselors'  time  that  is 
often  consumed  by  the  need  to  attend  to  behavioral  or  disciplinary  problems. 
The  Committee  urged  an  increased  focus  on  providing  counselors  with  ade- 
quate time  and  resources  to  concentrate  on  career-related  guidance. 


RECOMMENDATIONS 

1.  Invite  and  encourage  both  13-  and  17-year-olds  to 
discuss  career  plans  with  professional  staff  and 
not  to  restrict  such  discussions  to  peers  and 
parents. 

2.  Ensure  that  all  students  are  provided  with  guidance 
regarding  the  matching  of  their  own  goals,  interests, 
and  abilities  with  career  choice,  by  using  group 
guidance  techniques  where  possible  to  optimize  the 
use  of  counselors'  time. 

3.  Expand  the  informal  teacher  guidance  role  to  take 
full  advantage  of  teacher-student  interactions  that 
could  include  exploration  of  career  plans  and 
directions. 

4.  Ensure  that  when  career  tests  or  interests  invent- 
ories are  administered  to  students  for  purposes  of 
individual  career  planning  and  guidance: 

a)  the  goals,  purpose  and  usefulness  of  the 
test  are  explained  to  them. 

b)  the  results  and  meanings  of  the  results  are 
transmitted  and  explained  to  them. 


-42- 


Field  Experience 

STUDENTS'  FIELD  EXPERIENCE.     The  Committee  considered  student  questionnaire 
responses  that  reflected  the  extent  to  which  students  have  had  the  oppor- 
tunity to  participate  in  career-related  out-of-school  experiences.  They 
noted  that  85-89%  of  both  age  groups  reported  that  field  trips  sponsored 
by  their  schools  have  been  useful  to  them.  This  finding  was  evaluated 
against  the  perception  that  administrators  are  frequently  reluctant  to 
allocate  funds  for  such  activities,  perhaps  due  to  a  sensitivity  to  the 
restricted  resources  available  and  a  lack  of  understanding  of  the  value  of 
these  activities.  It  was  agreed  that  field  trips  offered  the  opportunity 
for  both  intended  and  peripheral  learning  to  occur  and  that  students' 
perceptions  should  be  considered  evidence  of  their  value. 

There  was  also  concern  over  the  fact  that  70%  of  17-year-olds  have  "never" 
done  any  volunteer  work  in  a  career  of  interest  to  them  and  that  only  18% 
(28%  in  "Big  Cities")  have  ever  participated  in  a  work-study  program. 
Further,  those  students  who  have  participated  in  work-study  programs  tended 
to  perform  less  well  than  other  students.  The  Committee  v;as  therefore 
concerned  about  the  limited  availability  of  work-study  experiences  and  about 
the  typical  restriction  in  the  types  of  students  who  are  assigned  to  these 
programs.  There  was  consensus  that  these  programs  should  be  viewed  as 
affording  valuable  field  experience  and  should  not  be  restricted  to 
students  demonstrating  financial  need.  In  the  context  of  current  or 
potentially  expanded  work-study  programs,  a  need  was  seen  to  strengthen  the 
relationship  between  the  work  to  which  students  are  assigned  and  in-school 
academic  pursuits. 

TEACHERS'  FIELD  EXPERIENCE.     While  not  keyed  to  specific  assessment  results, 
the  issue  of  field  experience  for  teachers  and  counselors  emerged  several 
times  during  Committee  discussions.  In  some  depth,  the  Committee  considered 
the  challenge  to  professionals  to  adequately  prepare  students  to  enter  the 
world  of  work,  to  be  sensitive  to  the  needs  of  potential  employers,  and  to 
help  familiarize  students  with  the  requirements  of  various  work  environ- 
ments. The  Committee  reiterated  several  times  the  benefits  to  be  accrued 
through  increased  interaction  between  business  and  industry  personnel  and 
counseling  and  teaching  staffs. 
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RECOMMENDATIONS 

L.  Provide  students  with  more  field  experience  and 
exposure  to  the  world  of  work  in  the  interest  of 
encouraging  career  awareness  and  exploration  con- 
nected to  sources  outside  of  the  school.  Speci- 
fically: 

a)  Expand  v/ork-study  programs,  cooperative 
and  distributive  education  programs,  and 
flexible  scheduling  to  include  more 
students  from  a  broader  range  of  back- 
grounds and  needs. 

b)  Attempt  to  provide  for  more  coordination 
between  these  programs  and  in-school 
academic  experiences. 

c)  Encourage  school  committees  to  explore 
with  their  professionals  the  educational 
worth  of  field  trips  in  order  to  increase 
their  awareness  of  the  value  of  and  their 
commitment  to  funding  such  trips. 

!.  Encourage  business,  industry,  government  and  human 
services  organizations  to  cooperate  with  educational 
institutions  in  order  to  provide  teachers  with  oppor- 
tunities to  become  more  familiar  with  non-teaching 
occupations.  Specifically: 

a)  Increase  the  extent  to  which  business  and 
industry  personnel  are  invited  into  the 
schools  to  make  presentations  to  students 
on  the  characteristics  of  various  jobs  and 
job  environments. 

b)  Encourage  teachers  to  visit  major  businesses 
and  industries  in  the  local  area  to  increase 
their  awareness  of  these  work  environments. 

3.  Seek  acknowledgment  from  school  personnel  that  career 
education  is  more  than  an  in-school  activity  and  that 
schools  should  take  the  responsibility  for  orchestra- 
ting the  educational  envivorment   for  students. 
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Student  and  Parent  Attitudes 


STUDENT  ATTITUDES.     According  to  student  questionnaire  results,  only  10-16^ 
of  students  at  both  age  levels  "dislike"  or  "strongly  dislike"  school  and 
the  Committee  was  pleasantly  surprised  at  the  large  majority  who  "like  it," 
"like  it  a  lot,"  or  think  "it's  okay."  By  contrast,  68°^  of  13-year-olds 
and  60%  of  17-year-olds  reported  that  their  school  experience  has  been  "not 
NQvy''   or  only  "somewhat"  useful  to  them  in  helping  them  to  fulfill  their 
career  objectives.  While  the  Committee  felt  that  these  percentages  may  be 
inflated  by  those  students  having  a  poor  attitude  toward  school  in  general 
and  were,  therefore,  not  responding  to  this  question  in  particular,  they 
were  nevertheless  concerned  about  the  high  percentages. 

Further,  students  whose  principals  rated  general  student  attitude  in  the 
school  as  "excellent"  or  "good"  outperformed  those  whose  principals  rated 
it  as  "fair"  or  "poor."  Statewide,  69-70%  of  the  principals  rated  student  . 
attitudes  in  the  top  two  categories,  but  the  porportion  of  such  high 
ratings  was  higher  in  "Residential  Suburbs"  and  lower  in  "Big  Cities"  and 
"Industrial  Suburbs."  While  the  Committee  recognized  the  complex  relation- 
ship between  attitudes  and  achievement,  as  well  as  the  caution  against 
drawing  simple  cause-effect  inferences,  they  felt  that  a  reminder  regarding 
the  importance  of  addressing  student  attitudes  on  an  individual  basis  was 
justifiable. 

PARENTAL  ATTITUDES  AND  INVOLVEMENT.     Because  61%  of  13-year-olds  and  48%  of 
17-year-olds  said  their  parents  are  involved  in  their  school  work  "quite  a 
bit"  or  "a  lot"  and  because  these  students  tended  to  outperform  those  whose 
parents  are  reported  involved  "hardly  at  all,"  the  Committee  was  very 
concerned  about  those  parents  who  display  low  levels  of  involvement.  The 
importance  of  parental  attitudes  and  involvement  was  further  substantiated 
by  the  fact  that  students  who  described  their  parents  as  wanting  them  to 
continue  their  schooling  after  high  school  "quite  a  bit"  or  "a  lot"  out- 
performed those  who  reported  weaker  parental  encouragement,  and  the  fact 
that  students  whose  principals  perceived  parental  support  of  the  school  to 
be  "excellent"  or  "good"  outperformed  those  whose  principals  rated  such 
support  as  "fair"  or  "poor." 

Special  concern  was  voiced  over  the  responses  to  these  questions  from 
students  and  principals  in  "Big  Cities"  and  "Industrial  Suburbs"  in 
particular.  In  comparison  to  statewide  results,  a  smaller  proportion  of 
students  reported  their  parents  as  strongly  encouraging  them  to  attend 
college  and  a  smaller  proportion  of  principals  rated  students'  attitudes  as 
"excellent"  or  "good."  By  contrast,  the  proportions  were  higher  in 
"Residential  Suburbs." 
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RECOMMENDATIONS 

1.  Convey  to  parents  and  the  local  community  that  students' 
general  attitudes  appear  to  be  more  positive  than  some 
might  expect. 

2.  More  fully  integrate  in  classroom  instruction  a  focus 
on  the  relevance  of  educational  excellence  in  general, 
and  subject  matter  knowledge  in  particular,  to  career 
planning. 

3.  Explore  with  students  their  feelings  about  the  relevancy 
or  irrelevancy  of  schooling  to  career  development  in 
order  to  determine  possible  directions  for  action. 

4.  Increase  the  effort  to  involve  parents  in  students' 
school  activities  and  work,  and  attempt,  where 
possible,  to  raise  their  awareness  of  the  relation- 
ship between  parental  expectations  and  attitudes  and 
student  attitudes  and  achievement. 


Current  Program  Enrollment 


According  to  student  reports,  53%  of  17-year-olds  statewide  are  enrolled  in 
college-bound  programs,  12%  in  vocational  programs,  and  13%  in  business 
programs.  However,  in  "Big  Cities"  and  "Industrial  Suburbs"  only  23%  and 
29%,  respectively,  are  presently  in  college-bound  programs.  As  noted  in  a 
later  discussion,  job  aspirations  of  students  in  "Big  Cities"  and  "Indus- 
trial Suburbs"  do  not  differ  from  those  of  students  statewide  despite  the 
differing  program  enrollment  figures,  and  the  Committee  wondered  whether 
or  not  these  students  are  exploring  job  possibilities  other  than  those 
v/hich  require  college  degrees. 

Particular  note  was  taken  of  the  fact  that  those  students  enrolled  in 
college-bound  programs  tend  to  outperform  other  students,  while  those  in 
vocational  programs  tend  to  perform  less  well  (with  "general"  and  "business" 
students  scoring  in  the  middle  and  about  the  same).  It  was  the  Committee's 
conclusion  that  special  attention  should  be  given  to  vocational  students 
in  order  to  insure  that,  by  comparison  with  the  programs  of  other  students, 
theirs  includes  as  broad  a  perspective  in  career  awareness  and  preparation. 
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One  of  the  more  interesting  findings  of  the  assessment  was  that  the  achieve- 
ment of  vocational  students  enrolled  in  Regional  Vocational -Technical  High 
Schools  was  identical  to  that  of  students  enrolled  in  vocational  programs 
in  comprehensive  or  academic  high  schools.  These  data  were  considered  to 
help  substantiate  the  fact  that  career  education  can  be  effectively  provided 
in  a  variety  of  settings  in  a  variety  of  ways.  The  Committee  wished  to 
extend  a  vote  of  confidence  to  those  vocational  high  schools  which  are 
providing  general  career  education  services  through  such  things  as  one-year 
exploratory  programs  and  which  are  not  restricting  students  to  technical 
training  with  a  limited  focus. 


RECOMMENDATIONS 

1.  Analyze  vocational  programs  in  all  school  settings  to 
ensure  that  students  enrolled  receive  comparably  broad 
preparation  in  career  awareness  and  preparation. 

2.  Encourage  vocational  high  schools  to  maintain  or 
implement  one-year  exploratory  programs  that  include 
career  awareness  and  decision-making  experiences. 


Student  Aspirations 

EDUCATIONAL  ASPIRATIONS.      It  was  noted  with  some  interest  that  students' 
aspirations  regarding  post-secondary  education  appeared  to  remain  fairly 
constant  from  the  13-  to  the  17-year-old  level;  41%  of  both  age  groups  plan 
to  go  to  four-year  college,  3-9%  plan  on  two-year  college,  and  11-13%  plan 
on  "additional  special  training"  (e.g.,  business,  nursing,  or  technical 
school).  However,  31%  of  13-year-olds  and  18%  of  17-year-olds  indicated 
that  they  "don't  know"  their  future  educational  plans.  As  further  sub- 
stantiation of  differences  between  kinds  of  communities,  it  was  noted 
that  52%  of  13-year-olds  and  57%  of  17-year-olds  in  "Residential  Suburbs" 
plan  on  attending  four-year  college,  as  compared  to  41%  of  both  age  groups 
statewide.  Moreover,  students  of  both  ages  who  plan  on  attending  four- 
year-college  performed  highest,  while  13-year-olds  who  plan  on  combining 
"job  and  school"  and  17-year-olds  who  plan  on  a  "full-time  job"  performed 
least  well . 
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JOB  ASPIRATIONS.     When  asked  to  identify  the  list  of  job  titles  that  in- 
cluded a  job  they  would  like  to  have  in  the  future,  55%  of  17-year-olds 
indicated  that  they  would  like  to  have  a  job  which  could  be  described  as 
"high  status"  (about  the  same  percentage  that  are  currently  enrolled  in 
college-bound  programs);  32%  want  what  might  be  called  "medium  status"  jobs, 
and  yery   few  (10%)  aspire  to  "low  status"  jobs. 

Considerable  discussion  focused  in  particular  on  the  percentage  of  students 
in  different  kinds  of  communities  who  aspire  to  "high  status"  jobs.  As 
compared  to  statewide  statistics,  a  smaller  proportion  (44%)  in  "Industrial 
Suburbs"  and  a  larger  proportion  (58%)  in  "Big  Cities"  aspire  to  such  jobs. 
It  appears  that  in  "Industrial  Suburbs"  a  larger  proportion  (46%)  of 
students  aspire  to  "medium  status"  jobs.  The  Committee  surmised  that 
students  in  "Big  Cities"  might  be  described  as  less  "realistic"  in  their 
job  aspirations  since  a  higher  proportion  want  "high  status"  jobs  while  a 
lower  proportion  are  enrolled  in  college-bound  programs.  On  the  other 
hand,  students  in  "Industrial  Suburbs"  may  be  more  aware  of  economic  con- 
straints in  their  local  area  or  develop  job  expectations  according  to  what 
they  perceive  as  available  in  the  local  community.  Despite  these  conject- 
ures, some  "realism"  must  be  operating  since  those  students  who  desire 
"high  status"  jobs  substantially  outperform  those  who  aspire  to  "low 
status"  jobs. 

It  was  also  noted  that,  to  a  large  degree,  students'  job  aspirations  are 
often  correlated  with  their  parents'  current  occupational  level  and  with 
the  extent  to  which  their  parents  encourage  college  attendance.  These 
findings  were  viewed  as  further  substantiation  of  the  importance  of  parent- 
al expectations  in  students'  career  decision-making.  However,  because  32- 
35%  of  both  age  groups  reported  that  they  are  "very  sure"  about  the  kind 
of  job  they  would  like  to  have  in  the  future,  43-46%  are  "somewhat  sure" 
and  only  22%  are  "not  "^ery   sure,"  the  Committee  was  impressed  that  students 
are  at  least  thinking  about  the  kind  of  job  they  would  like  to  have  in  the 
future. 


RECOMMENDATIONS 

1.  Address  students'  needs  for  more  valid  information  about 
the  job  market  and  labor  market  statistics  in  partic- 
ular, and  emphasize  the  importance  of  developing  realis- 
tic awareness  of  the  opportunities  available. 

2.  Increase  the  emphasis  on  helping  students  to  assess  their 
strengths  and  weaknesses  in  aptitude  and  to  match  their 
potential  with  jobs  available  in  the  marketplace. 
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RECOMMENDATIONS  (continued) 

3.  Encourage  students  to  explore  career  opportunities  as 
soon  as  they  are  ready  to  do  so  and  pay  particular 
attention  to  those  high  school  students  who,  when 
approaching  graduation,  are  still  not  sure  about  job 
or  school  plans. 

4.  Increase  students'  awareness  of  the  value  of  two-year 
college  and  technical  schools  in  providing  technical 
training  of  many  kinds  that  can  increase  employability 
and  the  range  and  quality  of  jobs  open  to  them. 

5.  Provide  teachers  and  counselors  with  more  in-service 
training  in  order  to  enable  them  to  provide  accurate 
information  on  the  labor  market  and  assist  students 
in  identifying  reasonable  career  choices  available  to 
them. 


General  Recommendations 


In  summary,  the  Committee  proposed  the  following  general  recommendations 
regarding  Career  Education  programs  and  assessment. 


RECOMMENDATIONS 

1.  The  Massachusetts  Department  of  Education  should  assume 
a  leadership  role  in  encouraging  strong,  sequenced,  and 
coordinated  K-12  career  education  programs. 

2.  The  Division  of  Occupational  Education  should  refrain 
from  directing  funds  exclusively  to  the  high  school  level 
but  rather,  include  elementary  and  middle  schools  as 
recipients  of  discretionary  funds. 
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RECOMMENDATIONS  (continued) 

3.  In  future  assessment  years,  take  e\/ery   opportuni 
increase  local  school  district  awareness  of  the 
and  usefulness  of  the  local  assessment  option, 
ically,  the  Department  should: 

ty  to 

validity 

Specif- 

a)  Ensure  that  information  about  the  option  is 
disseminated  early  to  allow  for  adequate  ti 
for  budget  allocations. 

■ 

me 

b)  Ensure  that  information  about  the  option 
reaches  Principals  and  Coordinators  (in 
addition  to  Superintendents)  such  that, 
where  interest  exists.  Superintendents  can 
be  encouraged  by  staff  to  adopt  the  option. 

c)  Allow  local  option  data  to  be  used  to 
support  applications  for  Department  dis- 
cretionary funds. 

d)  Specify  in  more  detail  the  potential  uses 
of  or  types  of  questions  that  can  be 
answered  by  local  option  data. 

e)  More  strongly  enlist  the  support  of 
Regional  Center  staff  to  "spread  the 
word"  about  the  local  option  opportunity. 
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APPENDIX  A 


Identification  of  Region  and  Kind  of  Community 
for  Massachusetts  School  Districts 
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APPENDIX  B 
Item  Results  by  Reporting  Group 


This  appendix  contains  tables  displaying  the  results  for  each  item  admin- 
istered to  students  at  each  level. 

The  two  tables  presented  here  provide  the  following  information  for  each 
test  item: 

•  the  number  of  the  test  question  as  it  appeared  in  the  test  booklet 

•  a  brief  description  of  the  test  item 

•  the  percentage  of  all  students  in  the  age  group  answering  correctly 

•  the  percentage  answering  correctly  in  each  of  the  Massachusetts 
reporting  groups  defined  by  the  variables:  sex  of  student, 
region,  and  kind  of  community 

•  where  the  question  was  tested  by  NAEP,  the  percentage  of  students 
in  the  Nation  and  in  the  Northeast  answering  correctly 

•  where  data  is  available,  the  percentage  of  Massachusetts  17-year- 
olds  answering  correctly  during  the  1974-75  assessment 

Tables  11  and  12  present  this  information  for  13-  and  17-year-olds,  respec- 
tively. Because  the  test  was  the  same  for  both  age  levels,  the  reader  can 
compare  the  achievement  of  the  two  age  groups  by  referring  to  identical 
item  numbers  on  Tables  11  and  12. 
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STATEWIDE  EDUCATIONAL  ASSESSMENT  REPORTS 


Limited  copies  of  the  following  previous  Statewide 
Educational  Assessment  Reports  are  available  at  the 
Department's  six  regional  centers: 


Reading  1974-75 

Mathematics  1974-75 

Decision  Making  1974-75 

Occupational  Attitudes  1974-75 

Occupational  Knowledge  1974-75 

Citizen  Attitudes  toward  Education  1974-75 

Public  Response  to  Educational  Goals  1974-75 

Writing  1975-76 

Social  Studies/Citizenship  1975-76 

Foreign  Languages  1975-76 

Science/Ecology  1976-77 

Consumer  Skills  1976-77 

School  Climate  1976-77 


For  further  information,  contact  one  of  the  regional 
assessment  coordinators  listed  on  the  other  side  or 
Matthew  Towle  at  (617)  727-8497. 
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USING  THIS  ASSESSMENT  REPORT 


The  findings  of  this  Assessment  Report  have  implications 
for  educators  and  others  at  both  the  state  and  local  levels. 
To  discuss  both  the  findings  and  ways  to  use  these  findings, 
the  Bureau  of  Research  and  Assessment  has  planned  the 
following  six  regional  workshops: 


DATE 


LOCATION 


REGIONAL  • 
ASSESSMENT 
COORDINATOR 


October  18,  1978 

October  19,  1978 

October  30,  1978 

October  31,  1978 

November  1,  1978 

November  8,  1978 


Northeast 
Regional  Center 

Greater  Boston 
Regional  Center 

Springfield 
Regional  Center 

Pittsfield 
Regional  Center 

Southeast 
Regional  Center 

Central  Mass. 
Regional  Center 


Peter  Coffin 
(617)  687-3351 

Athena  Costopoulos 
(617)  547-7472 

Ann  Schumer 
(413)  739-7271 

Winifred  Green 
(413)  499-0745 

Paul  Francis 
(617)  947-3240 

Adrienne  Margules 
(617)  835-6267 


We  hope  that  you  will  be  able  to  attend.  We  greatly 
appreciate  your  sharing  this  information  with  others. 


ASSESSMENT  CONTRACTOR:   1977-78 


National  Evaluation  Systems,  Inc, 

30  Gatehouse  Road 

Post  Office  Box  226 

Amherst,  Massachusetts  01002 

William  P.  Gorth 
Sherry  Ann  Rubinstein 
Martin  B.  Karl  in 
Dor it  Sejwacz 
Jay  Stewart 
Barbara  Hannus 
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